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Executive Summary 


Virtual learning and personalized learning have been at the forefront of education reform 
discussions for over a decade. Backed by almost $200 million philanthropic dollars from 
the Chan-Zuckerberg Initiative, the Gates Foundation, and others, Summit Public Schools 
has aggressively marketed its Summit Learning Platform to schools across the United States 
since 2015. As a result, the Summit Learning Program is now one of the most prominent 
digital personalized learning programs in the United States. 


Summit Public Schools, an 11-school charter network operating in California and Washing- 
ton, promotes its proprietary Summit Learning Program to potential “partner” schools as a 
free, off-the-shelf, personalized learning program. Summit’s marketing message trades on 
the alleged success of its schools. It claims to have developed a “science-based” personalized 
learning model of teaching and learning that results in all of its students being academically 
prepared for college. It further claims that its students succeed in college and are prepared 
to lead successful, fulfilled lives. These successes, it claims, are the result of its unique ap- 
proach to personalized learning and the use of the digital platform at the heart of that ap- 
proach. 


None of the claims made by Summit Public Schools have been confirmed by independent 
evaluators. Other than scant bits of self-selected information provided by Summit Public 
Schools itself, we found no evidence in the public record that confirms its claims. Summit 
Public Schools has not provided the information related to its claims that we requested in a 
California public records request. 
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Despite the lack of evidence to support the claims made by Summit Public Schools, the Sum- 
mit Learning Program has been adopted by nearly 400 schools across the country. While 
Summit has offered positive anecdotes and some selected data, there is no solid evidence 
that “partner” schools are experiencing the promised success. There are, however, a number 
of reports in the press that detail problems and dissatisfaction with the Summit Learning 
Program in partner schools and among students and parents. In addition, a Johns Hop- 
kins University evaluation of partner school classrooms in Providence, RI, found students 
were left to teach themselves with minimal guidance from teachers and aides. Reviewers 
described students engaged in extensive off-task behavior and progressing slowly and inef- 
fectively through their assigned work. 


Our review of Summit partner school contracts suggests that student data collected by the 
Summit Learning Platform under the terms of those contracts presents a potentially sig- 
nificant risk to student privacy and opens the door to the exploitation of those data by the 
Chan Zuckerberg Initiative and possibly by unknown third parties—for purposes that have 
nothing to do with improving the quality of those students’ educations. 


Virtual education and personalized learning are at the top of the education reform agenda 
in large measure because of hundreds of millions of dollars in funding and advocacy by phil- 
anthropic organizations (e.g., the Gates Foundation), large digital platforms (e.g., Facebook 
and Google), and venture capitalists anxious to access the school market. The COVID-19 
pandemic has turbo-charged these efforts, as schools across the country are struggling to 
find safe ways to educate their students. 


The rapid spread of the Summit Learning Program—despite a lack of transparency and the 
absence of convincing evidence that it can deliver on its promises—provides a powerful ex- 
ample of how policymakers are challenged when faced with a well-financed and self-inter- 
ested push for schools to adopt digital personalized learning programs. There is now an 
urgent need for policymakers to move quickly to protect the public interest by establish- 
ing oversight and accountability mechanisms related to digital platforms and personalized 
learning programs. 


We recommend that state departments of education establish an independent governmental 
entity responsible for implementing and enforcing the following recommendations to en- 
sure the quality of digital personalized learning in public schools and to adequately protect 
the privacy of student data. Specifically, such an entity should: 


* Require that the digital personalized learning programs be externally reviewed and 
approved by independent third-party education experts. As part of these program 
evaluations, the evaluators should review and approve the program curricular ma- 
terials, the pedagogical approaches as applied to the intended student populations, 
the validity of the assessment instruments, and the programmatic usefulness of data 
generated; 


Require that the assumptions and programming of all algorithms associated with per- 
sonalized learning materials be audited for bias and other possible risks to students 
before the algorithms are implemented; and 
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¢ Develop a standard data security agreement that protects the privacy and limits the 
use of all data, including de-identified data, collected by schools through personalized 
learning materials and related software platforms. 


http://nepce.colorado.edu/publication/summit-2020 


Table of Contents 


Introduction 
Studying Summit 
Summit Claims of Success 
Academic Performance 
Career and College Readiness 
Success in College 
Marketing Summit Public Schools 
A Flood of Philanthropic Dollars 
The Enduring Lure of “Free” Whole School Reform 
Data Collection and Use 
Privacy Concerns Meet Pedagogical Concerns 


Conclusion and Recommendations 


Notes and References 


http://nepce.colorado.edu/publication/summit-2020 


NEPC 


NATIONAL EDUCATION 
POLICY CENTER 


Bic CLaAiIMs, LITTLE EVIDENCE, LOTS OF MONEY: 
THE REALITY BEHIND THE SUMMIT LEARNING 
PROGRAM AND THE PusH TO ADOPT DIGITAL 
PERSONALIZED LEARNING PLATFORMS 


Faith Boninger, Alex Molnar, and Christopher M. Saldana 
University of Colorado Boulder 


June 2020 


Introduction 


For over a decade, schools across the United States have faced persistent pressure to adopt 
personalized learning programs. Nonprofit organizations,’ state leaders,” the education and 
popular press,? government agencies, and foundations‘ have often promoted personalized 
learning and the adoption of digital technologies as complementary reforms. Advocates ar- 
gue that tech-friendly personalized learning is a “student-centered” approach that will shift 
schools’ focus away from expecting all children to learn the same way at the same pace 
toward addressing each child’s individual needs and interests. In some instances the same 
reformers who have pushed for test-heavy, content-focused accountability systems are now, 
apparently without irony, promoting personalized learning as the cure for reforms they have 
spent the last two decades pushing on schools.5 


The effort to install personalized learning in schools across the country has to a considerable 
degree been fueled by focused philanthropic funding (e.g., the Bill and Melinda Gates Foun- 
dation and the Chan Zuckerberg Initiative),° advocacy by tech industry trade associations ” 
and large digital platforms (e.g., Facebook and Google), as well as investments by venture 
capitalists anxious to access the school market.*° At the same time, many states have adopt- 
ed policies that encourage the use of digital platforms in personalized learning programs by 
exempting these platforms from restrictions on data collection designed to protect student 
privacy.’° Although personalized learning proponents argue that it is much more than the 
use of digital platforms, the conception of competency-based pedagogy underlying the most 
prominent personalized learning approaches requires extensive data collection and perfor- 
mance feedback that only digital platforms can offer." 


Despite years of promotion and advocacy, an agreed-upon definition of personalized learn- 
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ing remains elusive.'* Moreover, there is as yet little research support to buttress the claims 
being made.® The RAND Corporation research that proponents often cite, for example, ac- 
tually failed to find results that support the widespread adoption of personalized learning 
programs."4 


RAND’s research examined the effectiveness of the practices the Gates Foundation promot- 
ed as integral to personal learning.'® While they found some positive effects on academ- 
ic achievement in schools that adopted personalized learning practices, RAND researchers 
could not confidently say that those practices were the cause of the effects.** RAND research- 
ers also were unable to find evidence that personalized learning practices have a distinct 
impact on non-academic skills such as creativity, collaboration, and communication (i.e., 
the “21%-century skills” thought to be promoted by personalized learning).” 


In this advocacy, policy, and research context, Summit Public Schools (SPS), a charter school 
network operating in California and Washington, began in 2015 to market its “Summit 
Learning Program” to schools around the country as a research-based model of whole school 
personalized learning reform. On its Summit Learning website and in supporting white pa- 
pers, SPS promoted its program to potential “partner schools.”'® Supported by philanthropic 
funding, it offered them its proprietary competency-based digital platform, project-based 
learning approach, and mentoring approach at no charge.'® SPS claimed that students in 
its schools learned to work independently, developed their cognitive and social-emotional 
skills, formed strong relationships with teachers, and succeeded academically both in its 
schools and subsequently in college.?° 


Since 2015, when it began marketing the Summit Learning Program (SPS refers to both 
the curriculum and instruction program that it uses in its schools and the program that it 
markets nationally to potential partner schools as “Summit Learning”) to schools outside its 
charter school network, SPS has repeatedly claimed that student success in its schools made 
SPS a model for others. In 2020, nearly 400 schools across the United States are using the 
Summit Learning Program, promoted since 2019 by a new nonprofit organization created by 
SPS, T.L.P. Education (doing business as “Summit Learning”).”* 


Given that research has not supported the claims of personalized learning advocates, it is 
important to understand whether and to what extent evidence supports SPS’s claims that 
students at its schools—and by extension, at schools adopting the Summit Learning Pro- 
gram—will learn more and experience greater academic success. Its aggressive marketing 
and national footprint makes it important for policymakers to determine whether or not 
SPS, together with its long-term engineering partner, the Chan-Zuckerberg Initiative, and 
its philanthropic supporters (see Appendix A) have developed an approach to personalized 
learning that has delivered on its promises and will continue to do so. 


Studying Summit 


Policymakers, district and school administrators, and communities have had little informa- 
tion other than marketing materials to use in evaluating the validity of claims about either 
SPS or its Summit Learning Program. For our analysis, we collected and analyzed publicly 
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available information to determine what evidence supported the outcomes reported by SPS. 
The information we reviewed included SPS and its Summit Learning Program websites, SPS 
reports, and other materials. We also examined reports and other documents related to SPS 
released by other organizations, stories in the education and popular media, funding data, 
state performance data, and SPS contracts with partner schools (see Appendix B for detailed 
description of our research methods).?? We conducted weekly internet searches and regular 
monitoring of the websites and social media accounts of organizations that might provide 
information about SPS, the Summit Learning Program, personalized learning, and commer- 
cialism in schools (see Appendix B). We also submitted a California Public Records request 
to SPS (see Appendix C).”3 


SPS’s leadership maintains a careful public face, and assiduously avoids providing more or 
different information than it has chosen to share as part of that public face. Our own experi- 
ence researching SPS and Summit Learning offers a case in point. It also mirrors that of dis- 
trict officials and parents who have tried, with limited if any success, to obtain information 
about their schools’ use of the Summit Learning Program.*4 


When we requested information from SPS directly, organization staff were unfailingly polite, 
but nonresponsive. They declined our initial request for an interview.”5 When we submitted 
our questions via a California Public Records Act (PRA) request, they declined to answer any 

: uestions about the Summit Learning Program and 
It is notable that SPS has ae Summit Learning Platform, claiming that (1) ac- 
been so reluctant and, in tivities relating to the Summit Learning Program and 
many instances, unwilling the Summit Learning Platform are not related to the 
to provide basic information operation of a SPS school and are therefore exempt 
about its educational from California’s Public Records Act (PRA); and that 
(2) SPS can no longer access “certain records relating 
to the Summit Learning Program” (see Appendix C). 


program and platform. 


It is notable that SPS, a public charter management organization, has been so reluctant and, 
in many instances, unwilling to provide basic information about the educational program 
and platform that it created and has aggressively promoted to schools around the United 
States for several years. SPS provided information to us only as legally required and on the 
narrowest possible terms. It has even made the claim that the Summit Learning Program 
and Summit Learning Platform, created and used by SPS, have nothing to do with the oper- 
ation of SPS (see Appendix C).?° 


In 2018-2019 SPS shifted the Summit Learning Program to T.L.P. Education.”’ T.L.P. is reg- 
istered as a nonprofit organization and there is no legal mechanism by which the public can 
compel the organization to provide information, including about the intellectual property 
that SPS licenses (e.g., curriculum and brand). Nevertheless, both Diane Tavenner (the CEO 
of SPS) and Priscilla Chan (Co-Founder and CEO of the Chan Zuckerberg Initiative) are on 
T.L.P. Education’s three-member board of directors. This suggests that these organizations 
are closely aligned. T.L.P. Education has not responded to any of our repeated written re- 
quests for information.?® 79 
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Summit Claims of Success 


Since 2015, Summit Public Schools (SPS) has marketed the Summit Learning Program as a 
response to the requests of schools outside its charter school network to share its recipe for 
success. The image of SPS and its Summit Learning Program as successful is cultivated on 
the SPS website and in documents such as the 2017 “white paper,” The Science of Summit.®° 


Despite its repeated claims of success and description of its curriculum and instruction pro- 
gram as “science-backed,” “evidence-based,” and “grounded in science,” SPS has declined 
to allow an independent evaluation of its curriculum and instruction program, including its 
proprietary digital platform, the Summit Learning Platform.*! Stanford University professor 
Larry Cuban observed several SPS classrooms. In a series of posts he described teachers who 
were readily available and engaged in meaningful, competent interactions with students.%? 
He also noted what he called strong “connective tissue” between SPS teachers and students, 
and teacher-mentors who were much more engaged with students than typical homeroom 
teachers.33 However, such anecdotal reports provide no independent research validation of 
SPS’s claims related to the efficacy of the Summit Learning Program in general, or of the 
efficacy of the “Summit Learning Platform” in particular. 


Academic Performance 


It is concerning that SPS offers only self-selected evidence to support its claims of success. A 
2016 Progressive Policy Institute publication lauding Summit, for example, was based only 
on selected test performance data provided by Summit Public Schools (SPS) itself. These 
test data showed impressive results on California’s Academic Performance Index (API) and 
on a test of academic progress (MAP) produced by an organization called NWEA.*4 However, 
the API and NWEA MAP tests were only reported for one year for each set of tests (2012 for 
API and 2014-2015 for NWEA MAP).%5 SPS has also created case studies of selected partner 
schools to demonstrate their success with the Summit Learning Program.?° While of inter- 
est, self-created case studies do not provide evidence of the systematic efficacy of the Sum- 
mit Learning Program in the many partner schools that have adopted it.3” 


In 2017, as part of a larger study of charter school students’ growth in state math and read- 
ing scores, the Center for Research on Education Outcomes (CREDO) included a snapshot 
of the performance of 398 SPS students for the 2012-2013 school year. CREDO found that 
attending SPS had a small but significant negative impact on math scores and no significant 
effect on reading scores.3° SPS, however, claims that standardized tests are not a valid way 
of assessing the cognitive skills that it values.2° At the same time, SPS has not provided in- 
dependent research evidence to support its claims that its students excel in the development 
of cognitive skills. 


Career and College Readiness 


Summit Public Schools (SPS) has emphasized its graduates’ readiness for 4-year college, 
claiming that 100% of its students are “eligible for 4-year college.”4° This claim does not 
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seem plausible, given the graduation rates published by the California Department of Ed- 
ucation (CDE) and the Washington Office of Superintendent of Public Instruction, and the 
college readiness data published by the CDE and the Washington Charter School Commis- 
sion. 


According to California and Washington state records, no school in the SPS charter school 
network has ever graduated 100% of its senior class. Since its first graduating class in 2006- 
2007, SPS four-year graduation rates have ranged from a low of 75% (Summit Rainier in 
2014-2015 and Summit Olympus in 2017-2018) to a high of 98.9% (Summit Prep in 2007- 
2008) (see Appendix D).4! 


CDE calculates the percentage of high school graduating students it determines to be ready 
for college and career.*? It determines graduates to be “prepared” for college/career if they 
attain one of the following:4% 


1. Pass the Grade 11 Smarter Balanced Summative Assessments in English Language Arts 
(ELA)/literacy and mathematics with a score of 3 or higher; 


Pass two Advanced Placement (AP) exams with a score of 3 or higher; 
Pass two International Baccalaureate (IB) exams with a score of 4 or higher; 


. Receive a State Seal of Biliteracy and pass the Grade 11 Smarter Balanced Summative 
Assessment in ELA with a score of 3 or higher; 


Pass the “a-g” courses required to apply to schools in the University of California or 
California State University systems with C minus or better and complete one of the 
following: pass Smarter Balanced Summative Assessments with a Level 3 or higher in 
ELA and at least a Level 2 in mathematics, or Level 3 or higher in mathematics and at 
least a Level 2 in ELA; complete one semester/two quarters/two trimesters of College 
Credit Courses with a grade of C- or better in academic/career and technical education 
(CTE) subjects where college credits are awarded for each course; score of 3 on one AP 
exam or score of 4 on one IB exam; or complete a CTE Pathway; 


. Complete a Career Technical Education (CTE) pathway and complete one of the fol- 
lowing: pass Smarter Balanced Summative Assessments with a level 3 or higher in ELA 
and at least a level 2 in mathematics, or level 3 or higher in mathematics and at least a 
level 2 in ELA; or complete one semester/two quarters/two trimesters of College Cred- 
it Courses with a grade of C- or better in academic/CTE subjects where college credits 
are awarded for each course; 


Complete two semesters, three quarters, or three trimesters of college coursework 
with a grade of C- or better in academic/Career Technical Education subjects where 
college credits are awarded; 


. Complete two years of Leadership/Military Science, score of Level 3 or higher in ELA 
and math, and Level 2 “Standard Nearly Met” or higher in other subject area. 


This is a complicated system; any given student can potentially qualify in a number of dif- 
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ferent ways. 


We examined the most recently released (2018-2019) college/career readiness percentages 
for the five SPS schools in California with a graduating class (Summit Everest, Summit Prep, 
Summit Rainier, Summit Shasta, and Summit Tahoma) to determine what might be said 
about the college/career readiness status of SPS students in general. 


The percentages of SPS students the state of California recognized as “prepared” on its mea- 
sures of college/career readiness fell well short of the 100% that SPS continues to claim,* 
ranging from from 56% (Summit Everest) to 74% (Summit Shasta)45 (See Appendix E). In 
addition, by a wide margin, SPS students demonstrated readiness by completing the course- 
work making them eligible to apply for admission to CA state universities rather than by any 
of the other possible means. 


In 2018-2019, between 92% (Summit Prep) and 98% (Summit Tahoma) of SPS students 
who qualified for the readiness designation did so by satisfying the high school coursework 
metric (see Appendix E). Across Summit Public Schools’ (SPS) five California schools with 
a high school graduating class in 2018-2019, 329 of the 505 graduating students qualified 
as “prepared” according to California’s college/career readiness calculations.** Of those 329 
“prepared” students, 315 qualified as prepared by passing the coursework required to make 
them eligible to apply for admission to California’s public universities; 181 passed Smarter 
Balanced Assessments with scores of 3 or higher in both ELA/literacy and mathematics; 
and 80 students scored 3 or higher on two Advanced Placement tests. In other words, SPS 
students are qualifying as “prepared” much more by completing high school coursework that 
SPS designs and grades than by performing at high levels on external measures of academic 
performance.*” 


The same is true for SPS’s Washington schools. The Washington State Charter School Com- 
mission’s Performance Framework Reports for 2018-2019 included data relevant to a col- 
lege readiness goal that SPS set for itself and that the state of Washington does not report 
for all its schools*®: “90% of students [will] finish the year college ready by scoring at least a 
70% or higher in all classes,” and “at least 50% of students [will] exceed basic college readi- 
ness by scoring 85% or higher in all classes.”49 In 2018-2019, all the SPS Washington schools 
achieved their goal (see Appendix E).5° By including all students, not only those graduating, 
this measure of readiness indicates how many of each SPS school’s students were on track 
to graduate college-ready. And, notably, it also allows SPS to define college readiness based 
not on any kind of commonly agreed-upon metric, but rather on the cognitive skills that SPS 
itself defines, assesses, and measures.** 


There is nothing inherently invalid about SPS students being declared prepared based on 
their successful completion of their high school coursework. SPS determines students to 
have successfully completed their coursework based on teachers’ evaluations of whether 
they demonstrate mastery of the cognitive skills that SPS has defined (See Appendix F). This 
being the case, it is essential that the rubric that SPS uses to assess its students’ cognitive 
skills be both valid and reliably used by teachers. 


We could find no publicly available documentation of the validity or reliability of the Sum- 
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mit Public Schools (SPS) Cognitive Skills Rubric.5* The Stanford Center or Assessment, 
Learning, and Equity (SCALE), which ostensibly worked with SPS on both an earlier and 
updated version of the Cognitive Skills Rubric, referred us to SPS for information about 
it (See Appendix G). SPS has not provided records we requested that (1) explain the basis 
for and/or that document the psychometric validation of the Cognitive Skills Rubric, (2) 
describe the training of teachers to use the Cognitive Skills Rubric, and (3) demonstrate 
teacher training’s effect on teacher consistency in assessing student mastery of cognitive 
skills (See Appendix C). As a consequence, although Summit Public Schools’ (SPS) claim 
that its students are college ready is technically correct, the overwhelming majority of those 
students meet the standards by taking SPS’s courses and being evaluated by SPS’s rubric. 
Given that Summit Public Schools (SPS) has provided no evidence that its Cognitive Skills 
Rubric has either internal or external validity, and that there is no evidence that student 
mastery of the cognitive skills detailed in the rubric is reliably assessed, the claims made by 
SPS related to its success in preparing students for college are without support and cannot 
be taken at face value (See Appendix G). 


Success in College 


Summit Public Schools (SPS) claims on its website that, “From our inaugural graduating 
class until now, 98% of all Summit graduates have been accepted into at least one four-year 
college” and that its students graduate at “2X the national average for college graduation.” 
We could find no data to confirm or disconfirm these assertions. When we asked in an open 
records request, SPS claimed to have no records relevant to these claims (see Appendix C).*4 
This is consistent with the pattern described above, of SPS making extreme claims about its 
students’ success and then being unable or unwilling to provide documentation to support 
those claims (see Appendix G). 


Marketing Summit Public Schools 


Given the lack of supporting data in the public record for Summit Public Schools’ (SPS) 
claims of effectiveness and its inability and/or unwillingness to provide evidence to support 
its claims, SPS’s success in convincing others to adopt its program based on its alleged suc- 
cess is astounding. This suggests that its ability to successfully market its program to schools 
across the country rests not on the efficacy of the Summit Learning Program so much as on 
millions of philanthropic dollars, guidance, and other support of such backers as the Gates 
Foundation. These well-heeled backers have funded a comprehensive and aggressive mar- 
keting campaign that promises underfunded U.S. schools struggling to provide a high-qual- 
ity education that they will be provided—without cost—a successful personalized learning 
program. 


Early on, SPS promoted itself®® to potential funders, particularly funders associated with 
the technology industry who might support the charter school network as a “laboratory of 
innovation” that featured the use of digital technology and could spearhead further adoption 
of such technology.*” Armed with philanthropic cash, SPS targeted parents, teachers, and 
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administrators of potential partner schools.*® 


A 2015 agreement between Summit and Facebook established the goals of developing and 
enhancing Summit’s existing platform software and collaborating on marketing strategy for 
its nationwide adoption.®? A June 2017 SPS final report to the Chan Zuckerberg Initiative 
(CZI) outlined public relations efforts to create social conditions amenable to widespread 
adoption of personalized learning.® The report described the marketing efforts as part of a 
strategy to create “one consistent narrative” promoting a positive answer to the question of 
“Does Summit Learning work?” 


Part of this marketing strategy was the 2017 publication The Science of Summit, which pur- 
ports to show that SPS’s pedagogical approach is research-based.” In the earlier 2017 CZI 
grant report, SPS lists plans to promote The Science of Summit through an in-depth blog 
series, a podcast series, a Facebook live series, as well as brochures, presentation slides, in- 
fographics, and slideshows—all of which SPS planned to complement with efforts to “build 
trust and advocacy among our audiences by engaging with key influencers who they respect 
and turn to for insights and opinions.”° 


The Science of Summit, in fact, offers no research evidence of the positive effect of SPS’s 
program on student performance.®? Rather, it describes choices SPS made as it developed 
its approach—to focus on project-based learning and generalized “cognitive skills,” noncog- 
nitive, social-emotional factors, and student-teacher relationships. It points to a historical 
context of research and theory that it interprets as consistent with these choices. These theo- 
ries and research would, however, also support choices leading to very different programs of 
curriculum and instruction. For example, rather than having students independently learn 
the content knowledge necessary for a given project as part of a digital competency-based 
learning approach, as SPS does, a different approach might have a class start a project by 
determining as a group the kinds of knowledge or skills they would need in order to com- 
plete the project, and how they might acquire them. In such an approach, the discussion and 
choices related to gaining the necessary knowledge are central to the project, not separate. 
Given that theory and research can lead to a variety of 
implementations and the fact that there has been no 


“The Science of Summit” 


offers no research evidence external research confirmation of the efficacy of Sum- 
of the positive effect of mit’s practices, The Science of Summit cannot be re- 
SPS’s program on student _ garded as providing research validation of the Summit 


performance. Learning Program. 


The Science of Summit resembles Summit’s other marketing materials in emphasizing the 
non-digital aspects of the program. On their websites, both SPS and Summit Learning avoid 
the words “computer,” “digital,” and “platform.” The words “self-directed” and “self-direc- 
tion” take their place, next to “mentoring” and “projects” (and, in the case of SPS, but not 
Summit Learning, “expeditions”).°+ °5 Although the Summit Learning Platform is the central 
organizer, delivery tool, and data hub for Summit’s approach to personalized learning, Sum- 
mit’s marketing materials de-emphasize its role. When the platform is mentioned at all, it is 
characterized as a feature that supports both teachers and students in their efforts to create 
graduates who know how to learn independently, who will attend, succeed, and graduate 
from college, and who will develop the personal and academic skills they will need to to lead 
fulfilled lives.°° 
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A Flood of Philanthropic Dollars 


Since 2011, Summit Public Schools (SPS) has received philanthropic funding totaling at least 
$177.6 million.*” Donors include the Bill and Melinda Gates Foundation, the Carnegie Cor- 
poration of New York, the Silicon Schools Fund, the Silicon Valley Community Fund, Meg 
Whitman, and the XQ Institute (see Appendix A). The Hechinger Report reports that the 
Chan Zuckerberg Initiative (CZI) alone committed $142.1 million to SPS since 2016.°° CZI’s 
website reports providing $48.8 million to SPS between 2016 and 2020 and $40 million to 
T.L.P. Education between 2018 and 2020 (see Appendix A).®° These financial contributions 
do not include significant in-kind contributions made by Facebook (and possibly CZI as 
well) to develop the Summit Learning Platform and the marketing strategy for the Summit 
Learning Program.” They also do not include additional financial contributions made to 
Summit partners, such as the Lindsay Unified School District.” 


Together, the influx of money, engineering skills, and business know-how from the digital 
technology sector and tech-friendly foundations supercharged the development of the Sum- 
mit Learning Platform and made possible the widescale sophisticated marketing program of 
the Summit Learning Program. 


By the 2019-2020 school year, the SPS charter school network had grown to 11 (from two 
in 2010-2011) and the number of Summit Learning partner schools had grown from zero in 
2013-2014 (prior to its partnership with Facebook) to over 380. 


The Enduring Lure of “Free” Whole-School Reform 


Public schools have for years been flooded with marketing materials promoting personal- 
ized learning even as they have been cricitized, often unfairly, for using an outdated “factory 
model” of curriculum and instruction. They are guilty, critics assert, of failing to equip their 
students for success in 21‘-century workplaces and lead satisfying fulfilled lives.”* Person- 
alized learning programs, including the Summit Learning Program, offer the promise that 
students at schools adopting them will be equipped with the skills that modern workplaces 
demand; that teachers will be freed from mundane tasks so they can mentor students; and, 
that student achievement and life competence will improve. 


Marketed as a cost-free solution to the academic problems faced by cash-strapped districts,” 
the Summit Learning Program promises an off-the-shelf system of whole-school reform that 
will transform struggling schools into successful schools. Such a promise cannot help but 
appeal to school and district decision-makers. Unfortunately, the recent history of whole- 
school reform models suggests that the results are likely to be disappointing. 


In the 1990s, the New American Schools Development Corporation (NASDC), a privately 
funded organization, supported the development and implementation of whole-school re- 
form models as part of both President George H.W. Bush’s (“America 2000”) and President 
Clinton’s (“Goals 2000”) education reform efforts. In the 1990s NASDC funded a number of 
school reform models that would appear to meet the criteria that Summit deems essential 
(i.e., they were internally consistent and supported by sound research). The implementa- 
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tion of NASDC models foundered in part because schools adopting the models could not, 
by themselves, afford either the cost of implementing them or of sustaining them—or both. 
Unsurprisingly, then, another significant issue was that school staff were not provided with 
adequate training in implementing the models and/or with ongoing in-service support.” 


Similar problems have cropped up among partner schools adopting the Summit Learning 
Program, detailed in several reports of schools failing to achieve anything like the prom- 
ised success.”5 SPS tends to characterize these failures as a result of partner schools having 
improperly implemented its program, or as non-representative.” If this is indeed the case, 
it would not be surprising: even though the program itself is provided without charge, the 
model imposes costs on schools that most schools likely cannot afford, including costs asso- 
ciated with providing the required digital infrastructure and devices. Further, even if staff 
use the Summit Learnng Program “off the shelf,” it is possible that schools may be unable to 
provide the level of staff training and ongoing in-service support to properly implement or 
maintain the model. 


The SPS model developed in a particular context under a particular set of conditions in a 
small number of low-enrollment schools in California and Washington state. It is not clear 
that whatever successes SPS may have had in its own schools can be abstracted into a guid- 
ing set of principles for widespread school reform, particularly for schools serving low-in- 
come communities with diverse student propulations. Between the Summit Learning Pro- 
gram’s initial launch in 2015-2016 and 2018-2019, 


It is not clear that whatever SPS reported that 393 schools contracted to use the 


successes SPS may have had gummit Learning Program.” A Chalkbeat analysis 


in its own schools can be found that about 25% of the schools that adopted it 
abstracted into a guiding set before the 2018-2019 school year dropped out along 
of principles for widespread the way.”° Whether and to what extent the remaining 
school reform. schools have held true to the model—as well as what 
results they have experienced overall—is unknown. 


When schools adopt the Summit Learning Program, they will predicably face a number of 
challenges. An outside source provides a completely new philosophy, curriculum, and dig- 
ital platform, and along with them a vast set of unfamiliar tasks.”? Given these many new 
and different demands on teacher time, it is not hard to imagine that the framework of the 
program, the digital Summit Learning Platform, is likely to be privileged over the other pro- 
gram features as partner school staff struggle to keep up. That is, more teacher time must be 
spent on tasks related to the plaform, crowding out the time that they theoretically would be 
spending on student-facing activities such as mentoring and supporting student projects.®° 


Schools that face the greatest financial challenges, that are understaffed, and that support 
large numbers of students with special needs are likely to find even the demands of learn- 
ing and mastering an ever-changing platform beyond their capabilities. A Johns Hopkins 
University team found just such a situation when it reviewed Summit Learning Program 
classrooms in Providence, RI, in 2019.*! The reviewers found students in Summit Learning 
Program classrooms proceeding slowly through the program’s curriculum, trying to guess 
their way through material with minimal teacher supervision.®? These students were more 
disengaged and off-task than students in traditional classrooms in the same district, and 
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they were limited to learning how to answer problems in the program’s assessment format.*? 
Students reported disliking the program and being “burned-out” by extensive screen time.** 


In practice, it appears that in partner schools the Summit Learning Program can often leave 
children to teach themselves, which means that students in schools like those in the Provi- 
dence district may not master the curriculum or have other meaningful learning experienc- 
es. As we have already noted, whereas SPS portrays its approach as scientific and generaliz- 
able, the culture created over time in SPS is the unique result of its history and development. 
It would be hard, if not impossible, to transfer this culture to disparate partner schools.*5 
What can be used, no matter how imperfectly, however, is the digital Summit Learning 
Platform. And, in contrast to the images conjoured up by personalized learning advocates, 
the Summit Learning Platform operationalizes a data-hungry, hyper-rational, competen- 
cy-based approach to learning. 


Data Collection and Use 


The Summit Learning Platform collects a lot of data about students from partner schools. 
It obtains some of these data—such as English Language Learner information, school at- 
tendance informaton, state assessment data, and bus pickup and drop-off locations—from 
school data systems as part of Summit Learning’s role as a “school official.”®° It gets oth- 
er data—such as project grades, student goals, and mentoring notes—when teachers and 
students voluntarily enter them. It collects still other data automatically as students work 
within the platform. Among these are such details as students’ content assessment attempts 
and results, times and locations of activity, and IP addresses. Data are used as part of the 
educational program, to improve it, and to market it. It is not clear to what other purposes 
the data may be put. 


The contracts signed with Summit Public Schools (SPS) (and, since 2019-2020, with T.L.P. 
Education) that we reviewed are careful to distinguish personally identifiable “student data” 
and “de-identified data.” The contracts set limits on the use of “student data.” For example, 
they prohibit the sale of “student data” and its use for purposes other than to provide the 
services specified in the contract. They also provide for SPS (and, since 2019-2020, T.L.P. 
Education) to “destroy” “student data” by de-identifying it. This means that when schools, 
as allowed by their contract, request that data collected from their students be destroyed, it 
may not actually be destroyed in the sense that most people understand the term. Rather, it 
may be transformed into de-identified data. 


The contracts we examined permit SPS (and now T.L.P. Education) access to and use of 
de-identified student data in perpetuity. Contracts signed in 2018-2019 explicitly provide 
for SPS (and now T.L.P. Education) to use de-identified student data “for any lawful pur- 
pose” (the same language appears in the current Data Privacy Addendum on the Summit 
Learning website).°” By extension, this means that the Chan Zuckerberg Initiative (CZI), its 
long-term technology partner,** may also access de-identified student data to use in any way 
it wishes in perpetuity. Uses may include analyzing it for insights about student learning 
and psychology using big data statistical methods, selling it to third parties, and creating 
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for-profit enterprises to exploit it—all without the knowledge and consent of either students 
or their parents.°*? 


The privacy protections we reviewed in SPS’s contracts with partner schools seem impres- 
sive on their surface; however, the provisions related to de-identified data are telling. SPS 
assures partner schools that it will not re-identify the data. However, this is far from the 
whole picture. Clause 4.6 of the Data Privacy Addendum to the 2018 contract(s) we re- 
viewed provides for (personally identifiable) student data to be de-identified as a means of 
“destroying” it, and exempts de-identified data from the obligation to destroy data.°° This 
is important because the data never have to actually be destroyed, and they can be reidenti- 
fied. Computer scientists and data experts have known for years that complex de-identified 
datsets—such as the student datasets held by SPS—can easily be re-identified.” There can 
be little doubt that contract language related to the “destruction” of data was crafted with 
full knowledge that de-indentified data can be easily re-identified and thus are not in fact 
“destroyed.” In effect, the contract gives CZI access to student data, and it may do whatever 
is legally permissible with those data, in perpetuity. 


It is important to note that the Chan Zuckerberg Initiative (CZI) is not a charity or a phil- 
anthropic organization: it is a business.” As such, it can make political contributions. It can 
and does make charitable contributions. It can and has invested in several for-profit compa- 
nies,®3 and it can and has engaged in political lobbying.%4 


Given this background, it would be reasonable to assume that CZI expects some gain from its 
collaboration with SPS and now T.L.P. Education. It also seems likely that what it stands to 
gain is access to significant amounts of student data that it can convert into a considerable 
amount of money. 


Facebook has taught the world that data are fungible and can mean big money. They can also 
be very dangerous when controlled by an opaque organization immune to public oversight. 
Regardless of who is named the owner of student data in partner school contracts, as Sum- 
mit Learning’s technology partner CZI has full access to those data. 


Given this context it is concerning and suggestive to note that compared to the 2017 contract 
we reviewed, the 2018 partner school contracts we analyzed expanded Summit Learning’s 
(and thereby CZI’s) right to access and use de-identified student data.° Any use to which 
SPS, T.L.P. Education, or CZI may make of data that the Summit Learning Platform collects 
about students is independent of any benefit the Summit Learning Program may provide to 
its students. As we have already noted, the student data can be easily re-identified and there 
is a significant financial incentive to do so. 


Privacy Concerns Meet Pedagogical Concerns 


It is important to understand that the algorithms governing the Summit Learning Platform’s 
curriculum delivery, data collection and analysis, and other efforts have been created via 
subjective decisions on the part of Summit Public Schools (SPS) (or Facebook’s or the Chan 
Zuckerberg Initiative’s) staff—and perhaps unknown others.°*® °7 Although algorithms are 
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commonly thought of as purely mathematical and objective, they are in fact theories that 
reflect which pieces of information their authors consider valuable and how their authors 
believe those pieces of information should be fit together and used to draw conclusions. 


Therefore, all algorithms, including those in the Summit Learning Platform, necessarily re- 
flect the values, assumptions, social positions, and interests of their authors. For this reason, 
researchers and advocates have called for algorithms to be audited for possible bias.9* To 
date, SPS has not provided any information about the entities involved in making decisions 
about the Summit Learning Program’s curriculum and assessments or the qualifiations of 
decision-makers; neither has it provided access to algorithms for disinterested experts to 
evaluate (See Appendix C).% 


The transparency of the algorithms included in the Summit Learning Platform is essential 
to determine whether the inferences those algorithms draw about students are valid and to 
evaluate how they influence members of the school community to act in relation to students. 
SPS offers no such transparency. 


Further, Summit Public Schools has presented the Summit Learning Program as amenable 
to customization to meet different communities’ varying values and needs. In reality, the 
Summit Learning Platform is centrally programmed with course content and with the algo- 
rithms that guide students’ experience and that make many consequential decisions about 
them. The proprietary curtain that keeps the Summit Learning Platform’s algorithms from 
review contrasts with the way in which, for instance, publishers commonly submit textbooks 
for review. It effectively turns school curriculum into a “black box” that operates with no 
oversight by or accountability to the public. 


Marketing claims aside, there is little evidence that SPS’s program of curriculum and peda- 
gogy either improves outcomes for students or personalizes instruction in ways that mean- 
ingfully distinguish it from any number of other educational programs. It is important to 
note that there are other ways to personalize education that do not require reliance on digital 
delivery or data collection. Alfie Kohn’s child-centered approach,'°° James Macdonald’s per- 
son-oriented curriculum,’” and Lorrie Shepard and colleagues’ sociocultural approaches,'°? 
for example, focus on providing opportunities for children to create their own meaning from 
the curriculum.’ As already noted, to a considerable degree the Summit Learning Program 
focuses on student development within a narrow pedagogical framework that emphasizes 
assessment and data collection. We know further that these data may be subsequently be 
transferred with virtually no transparency, oversight, or accountability to unknown, other 
parties. 


Conclusion and Recommendations 


Despite many red flags and general lack of research support, advocacy for the adoption of 
digital personalized learning in general continues unabated. The Summit Learning Program 
is a slickly marketed digital personalized learning program that is promoted as a “free” and 
off-the-shelf program to schools all over the country. Our analysis suggests that, rhetoric 
notwithstanding, the Summit Learning Program does not deliver on its promise to provide 
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a higher quality education, with superior student outcomes, in the schools that adopt it. 
Moreover, aside from any valid education purpose, the Summit Learning Platform approach 
to assessment, coupled with enabling contract language, opens the door to the transfer of 
large amounts of student data to third parties without oversight or accountability. These 
concerns are compounded by the overall lack of organizational transparency of Summit Pub- 
lic Schools (SPS) and T.L.P. Education. 


The rapid spread of the Summit Learning Program—despite a lack of transparency and the 
absence of convincing evidence that it can deliver on its promises—provides a powerful ex- 
ample of how policymakers are challenged when faced with a well-financed and self-inter- 
ested push for schools to adopt digital personalized learning programs. There is now an 
urgent need for policymakers to move quickly to protect the public interest by establish- 
ing oversight and accountability mechanisms related to digital platforms and personalized 
learning programs. 


We recommend that state departments of education establish an independent governmen- 
tal entity responsible for implementing and enforcing the following recommendations to 
ensure the quality of digital personalized learning in schools and to adequately protect the 
privacy of student data. Specifically, such an entity should: 


¢ Require that the digital personalized learning programs be externally reviewed and 
approved by independent third-party education experts. As part of these program 
evaluations, the evaluators should review and approve the program curricular ma- 
terials, the pedagogical approaches as applied to the intended student populations, 
the validity of the assessment instruments, and the programmatic usefulness of data 
generated; 


Require that the assumptions and programming of all algorithms associated with per- 
sonalized learning materials be audited for bias and other possible risks to students 
before the algorithms are implemented; and 


Develop a standard data security agreement that protects the privacy and limits the 
use of all data, including de-identified data, collected by schools through personalized 
learning materials and related software platforms. This agreement should require that 
the school collecting data do the following: 


o Clearly explain what kinds of data it proposes to collect from students, how it 
proposes to store the data and for how long, who will be allowed access, and what 
educational purpose all data collected will serve; 


Refrain from collecting any data not directly relevant to an agreed-upon specified 
educational purpose and from using any data, including de-identified data, col- 
lected for any purpose other than the agreed-upon specified educational purpose; 


o Vest the ownership of any and all student data collected with the student or the 
adult(s) legally responsible for him or her; 


Prohibit any school from making participation in its curriculum and instruction, 
assessment, or any other part of its academic program contingent on students or 
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parents granting any third-party access to their data in any form whatsoever; 


Provide a standard, explicit, and easy-to-understand explanation of what kind of 
data use is incorporated in such activities as “improving” websites, apps, or ser- 
vices, or in “personalizing and improving” users’ experience with educational soft- 
ware, and allow students to opt in to such activities; 


Prohibit schools from entering into any agreement with a third party that abridges 
any of the previously stated requirements. 


Additionally, as a result of the problems we identified in our study of Summit Public Schools 
and its Summit Learning Program, we recommend that state, district, and school-level offi- 
cials considering personalized learning be especially cautious about adopting commercially 
produced personalized learning programs. To avoid introducing significant pedagogical and 
privacy threats to their schools, we recoomend that their first steps be to: 


¢ Define the pedagogical values, goals, and practices they hope to achieve via personal- 
ized learning before considering the adoption of a particular program; 


Clarify the ways in which an ideal personalized learning approach would advance their 
self-defined values, goals, and practices; 


Identify potential negative consequences that may be associated with personalized 
learning and devise strategies for avoiding them; 


Determine which of their defined values, goals, and practices can be best achieved by 
non-digital means and which require digital means; 


Use the steps enumerated above either as a framework for designing their own person- 
alized learning program or for assessing the suitability of any commercially provided 
programs being considered. 
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personalized learning implementation and effects. Santa Monica, CA: RAND Corporation. Retrieved June 
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3, 2020, from https: //www.rand.org/content/dam/rand/pubs/research_reports/RR2000/RR2042/RAND_ 
RR2042.pdf 


Students in the schools defined as “personalized learning schools” showed greater growth in math and reading 
scores on the Northwest Evaluation Association’s (NWEA) Measures of Academic Progress (MAP) assessment 
than the national average, and more than 50% of the students from these schools showed greater growth than 
“virtual students” created to serve as comparison standards. 


NWEA (formerly the Northwest Evaluation Association) is a testing company based in Oregon. Its MAP 
Growth tests use “adaptive” algorithms to begin with a question appropriate for a student’s grade level and 
then choose subsequent questions throughout the test in response to student responses. For more information 
on NWEA and MAP Growth, see: 


NWEA (2018). MAP Growth [webpage]. Retrieved June 3, 2020, from https://www.nwea.org/map-growth/ 
RAND’s research is reported in detail here: 


Pane, J.F., Steiner, E.D., Baird, M.D., & Hamilton, L.S. (2015). Continued progress: Promising evidence on 
personalized learning. Santa Monica, CA: RAND Corporation. Retrieved June 3, 2020, from https://www. 
rand.org/pubs/research_reports/RR1365.html 


Pane, J.F., Steiner, E.D., Baird, M.D., Hamilton, L.S., & Pane, J.D. (2017). Informing progress: Insights on 
personalized learning implementation and effects. Santa Monica, CA: RAND Corporation. Retrieved June 

3, 2020, from https: //www.rand.org/content/dam/rand/pubs/research_reports/RR2000/RR2042/RAND_ 
RR2042.pdf 


For a follow-up discussion, see: 


Pane, J.F. (2018). Strategies for implementing personalized learning while evidence and resources are 
underdeveloped (p. 4). Santa Monica, CA: RAND Corporation, 2018. Retrieved June 3, 2020, from https:// 
www.rand.org/pubs/perspectives/PE314.html 


For a review of RAND’s 2015 report, see: 


Penuel, W.R., & Johnson, R. (2016). Review of “Continued progress: Promising evidence on personalized 
learning.” Boulder, CO: National Education Policy Center. Retrieved June 3, 2020, from https://nepc. 
colorado.edu/thinktank/review-personalized-learning 


RAND’s study of personalized learning found that schools were unable to determine appropriate measures of 
the skills they considered “21 Century,” such as critical thinking and collaboration. 


Pane, J.F., Steiner, E.D., Baird, M.D., Hamilton, L.S, & Pane, J.D. (2017). Informing progress: Insights on 
personalized learning implementation and effects (p. 11). Santa Monica, CA: RAND Corporation. Retrieved 
June 3, 2020, from https://www.rand.org/content/dam/rand/pubs/research_reports/RR2000/RR2042/ 
RAND_RR2042.pdf 
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Summit Public Schools (n.d.). The science of Summit. Retrieved June 2, 2020, from https://summitps.org/ 
wp-content/uploads/2018/09/The-Science-of-Summit-by-Summit-Public-Schools_08072017-1.pdf [The 
document is not dated, but the filename appears to have a date of August 7, 2017] 


Summit Public Schools reported to the Chan Zuckerberg Initiative (CZI) in 2019 that it had begun requiring 
partner schools to “adopt all three components of the instructional approach (i.e., Project-Based Learning, 1:1 
Mentoring, and a Self-Directed Learning Cycle).” The self-directed learning cycle is the learning of content 
knowledge via the platform. 
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Summit Public Schools (2019, January 31). Chan Zuckerberg Foundation final report (p. 7). Retrieved June 
3, 2020, from https: //cdn.vox-cdn.com/uploads/chorus_asset/file/19931497/Grant_Reports_PRA_M. 
Barnum_2_2_1.pdf 


Summit Public Schools (n.d.). The science of Summit (pp. 15, 18). Retrieved June 2, 2020, from 
https://summitps.org/wp-content/uploads/2018/09/The-Science-of-Summit-by-Summit-Public- 
Schools_08072017-1.pdf [The document is not dated, but the filename appears to have a date of August 7, 
2017] 


Summit Learning (n.d.). Creating learners for life [webpage]. Retrieved April 24, 2020, from https://www. 
summitlearning.org/ 


T.L.P. Education was formed in 2018 and took over administration of the Summit Learning Program for the 
2019-2020 school year. 


Summit Learning (n.d.). Who is T.L.P. Education (aka “Summit Learning”)? [webpage]. Retrieved February 
19, 2020, from https://help.summitlearning.org/hc/en-us/articles/360021179053-Who-is-T-L-P-Education- 
aka-Summit-Learning- 


Summit Learning (2019, April 4). Andrew Goldin named executive director of T.L.P. Education [webpage]. 
Cision PR Newswire. Retrieved May 31, 2020, from https://www.prnewswire.com/news-releases/andrew- 
goldin-named-executive-director-of-tlp-education-300824991.html 


For numbers of partner schools over time, see: 


Barnum, M. (2019, May 23). Summit Learning, the Zuckerberg-backed platform, says 10% of schools quit 
using it each year. The real figure is higher. Chalkbeat. Retrieved February 9, 2020, from https://chalkbeat. 
org/posts/us/2019/05/23/summit-learning-the-zuckerberg-backed-platform-says-10-of-schools-quit-using- 
it-each-year-the-real-figure-is-higher/ 


We were able to obtain three fully executed contracts between Summit Public Schools and public school 
districts from parents who obtained them from their districts: 


Summit Learning Program Agreement, Summit Public Schools and Fairview Park City School District, May 1, 
2018 


Summit Learning Program Participation Agreement, Summit Public Schools and New Egypt High School, May 
11, 2017 


Summit Learning Program Agreement, Summit Public Schools and Wellington Unified School District 353, 
March 30, 2018 


As of June 8, 2020, Summit Public Schools has not provided any of the records we requested in our Public 
Records Act request submitted November 5, 2019. 


Balot, T. (2019, September 6). Personal communication (telephone) with Faith Boninger. 
Henning, T. (2020, January 5). Personal communication (email) with Faith Boninger. 


Tabor, N. (2018, October 11). Mark Zuckerberg is trying to transform education. This town fought back. New 
York Magazine (nymag.com). Retrieved June 3, 2020, from http://nymag.com/intelligencer/2018/10/the- 
connecticut-resistance-to-zucks-summit-learning-program.html 


Uong, C. (2019, October 18). Personal communication (email) with Faith Boninger. 


In its response to our Public Records Act request for records pertaining to the Summit Learning Platform, 
Summit Public Schools claimed that “to the extent activities relating to the Summit Learning Program and the 
Summit Learning Platform are unrelated to the operation of a Summit Public Schools school, they are exempt 
from the Public Records Act” (See Appendix C). 
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27 Summit Learning (n.d.). Who is T.L.P. Education (aka “Summit Learning”)? [webpage]. Retrieved February 
19, 2020, from https://help.summitlearning.org/hc/en-us/articles/360021179053-Who-is-T-L-P-Education- 
aka-Summit-Learning- 


It is worth noting that the address given for T.L.P. Education (doing business as “Summit Learning”) is the 
address of the lawyer for Summit Public Schools. 


The external law office used by Summit Public Schools is Procopio, Cory, Hargreaves & Savitch, LLP. The 
address for T.L.P. Education is c/o Procopio at 1117 California Ave #200, Palo Alto, CA 94304. 


Public Employment Relations Board (2019, December 5). Communication to Procopio, Cory, Hargreaves & 
Savitch, LLP [mail] UNITE SUMMIT, CTA/NEA v. Summit Public Schools, Unfair Practice Charge No. SF-CE- 
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Summit Learning (n.d.). How can I contact T.L.P. Education? [webpage]. Retrieved February 21, 2020, from 
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Christopher Saldafia wrote to info@summitlearning.org, the address provided by T.L.P. Education, and asked 
to speak to someone about the Summit Learning Program on October 18, October 23, November 4, November 
16, November 22, December 5, December 11, December 30, January 9, and January 24, January 31, and 
February 7. He did not receive a reply. He sent the same request to the land address indicated on the Summit 
Learning website on January 27, 2020 and February 14, 2020. 


The email address may be found at: 


Summit Learning (n.d.). How can I contact T.L.P. Education? [webpage] Retrieved June 3, 2020, from 
https://help.summitlearning.org/hc/en-us/articles/360020980974 


Interestingly, T.L.P. senior staff did provide interviews to the Hechinger Report. 


Before it moved the Summit Learning Program, Summit Public Schools’s “About Us” page on its website 
included a history of Summit Public Schools and the Summit Learning Program, a description of its Summit 
Learning Program, and statistics about its students’ outcomes: “100% Eligible For 4-Year College; 98% 
Accepted to 4-Year College; 55% Graduate College Within 6 Years—that’s”: “2X The National Average.” This 
page is no longer available, although those same statistics (except for “55% Graduate College Within 6 Years” 
— only the translation to “2X The National Average for College Graduation” currently appears) can be found on 
Summit Public Schools’ “Our Results” webpage. 


Summit Learning (n.d.). About us [webpage]. Retrieved August 21, 2019, from https://www.summitlearning. 
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org/wp-content/uploads/2018/09/The-Science-of-Summit-by-Summit-Public-Schools_08072017-1.pdf [The 
document is not dated, but the filename appears to have a date of August 7, 2017] 


Summit Public Schools (n.d.). Our results [webpage]. Retrieved May 11, 2020, from https://summitps.org/ 
the-summit-model/our-results/ 


See also: 
Tavenner, D. (2019). Prepared: What kids need for a fulfilled life. New York, NY: Currency. 
For claims about the scientific basis of Summit Public Schools’ curriculum and instruction program, see: 


Summit Learning (n.d.). About us [webpage]. Retrieved August 21, 2019, from https://www.summitlearning. 
org/about-us [no longer accessible] 


Summit Public Schools (n.d.). The science of Summit. Retrieved June 2, 2020, from https://summitps.org/ 


http://nepc.colorado.edu/publication/summit-2020 28 of 41 


wp-content/uploads/2018/09/The-Science-of-Summit-by-Summit-Public-Schools_08072017-1.pdf [The 
document is not dated, but the filename appears to have a date of August 7, 2017] 


For discussion of Summit Public Schools’ reluctance to submit its curriculum and instruction program to 
independent evaluation, see: 


Barnum, M. (2019, January 17). Summit Learning declined to be studied, then cited collaboration with 
Harvard researchers anyway. Chalkbeat. Retrieved June 3, 2020, from https://www.chalkbeat.org/posts/ 
us/2019/01/17/summit-learning-research-harvard/ 
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Cuban. L. (2016, March 13). Summit charter school teachers integrating technology, part 1—-Biology [blog 
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larrycuban.wordpress.com/2016/03/13/summit-charter-school-teachers-integrating-technology-part-1- 
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Cuban, L. (2016, March 16). Summit charter teachers integrating technology, part 2: History. Larry Cuban 
on School Reform and Classroom Practice. Retrieved May 20, 2020, from https://larrycuban.wordpress. 
com/2016/03/16/summit-charter-teachers-integrating-technology-part-2-history/ 


Cuban, L. (2019, August 21). Personal communication (telephone) with Alex Molnar. 


“NWEA is a research-based, not-for-profit organization that supports students and educators worldwide by 
creating assessment solutions that precisely measure growth and proficiency—and provide insights to help 
tailor instruction.” 


NWEA (2020). About NWEA [webpage]. Retrieved February 25, 2020, from https: //www.nwea.org/about/ 
The publication does not indicate whether the API scores are 2011-2012 or 2012-2013. 


Osborne, D. (2016, ). Schools of the future: California’s Summit Public Schools. Progressive Policy 
Institute. Retrieved February 26, 2020, from https://www.progressivepolicy.org/wp-content/ 
uploads/2016/01/2016.01-Osborne_Schools-of-the-Future_Californias-Summit-Public-Schools.pdf 


Summit Learning (n.d.). Case studies [webpage]. Retrieved May 17, 2020, from https://blog.summitlearning. 
org/tag/case-studies/ 


Summit Public Schools (2019, January 31). Chan Zuckerberg Foundation final report. Retrieved June 3, 
2020, from https://cdn.vox-cdn.com/uploads/chorus_asset/file/19931497/Grant_Reports_PRA_M. 
Barnum_2_2_1.pdf 


Summit Public Schools (SPS) funded two Harvard University researchers in 2016-2017 to develop a proposal 
for a comprehensive evaluation study, but ultimately rejected their proposal, citing the possibility that doing 
an evaluation study might burden teachers or preclude changes to the platform. It has not provided records 
we requested about the decisions to solicit and then not go forward with the proposed research, nor has it 
provided records we requested of any research reports in its possession that evaluates SPS outcomes. This 
information was requested from SPS in a California Public Records Act (PRA) request submitted on November 
5, 2019. See Appendix C for all correspondence releated to this PRA request. 


For discussion of the proposed Harvard evaluation, see: 


Barnum, M. (2019, January 17). Summit Learning declined to be studied, then cited collaboration with 
Harvard researchers anyway. Chalkbeat. Retrieved June 3, 2020, from https://www.chalkbeat.org/posts/ 
us/2019/01/17/summit-learning-research-harvard/ 


Woodworth, J., Raymond, M., Han, C., Negassi, Y., Richardson, P., & Snow, W. (2017). Charter management 
organizations 2017 (p. 91). Palo Alto, CA: Center for Research on Education Outcomes. Retrieved February 11, 
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2020, from https: //credo.stanford.edu/sites/g/files/sbiybj6481/f/cmo_final.pdf 


Barnum, M. (2019, January 17). Summit Learning declined to be studied, then cited collaboration with 
Harvard researchers anyway. Chalkbeat. Retrieved June 3, 2020, from https://www.chalkbeat.org/posts/ 
us/2019/01/17/summit-learning-research-harvard/ 


Summit Public Schools (n.d.). Our results [webpage]. Retrieved May 18, 2020, from https://summitps.org/ 
the-summit-model/our-results/ 


Beginning in 2017-2018, the California Department of Education began reporting a five-year graduation rate 
for the preceding year’s graduating class. Five-year graduation rates have been reported for Summit Prep 
(95.7% in 2017-2018 and 99% in 2018-2019), Summit Everest (92.8% in 2017-2018 and 92.2% in 2018-2019), 
Summit Rainier (92.4% in 2017-2018 and 93.9% in 2018-2019), Summit Tahoma (87.9% in 2017-2018 and 
92.5% in 2018-2019), and Summit Shasta (98.0% in 2017-2018 and 98.1% in 2018-2019) 


California Department of Education (2019, December 12). Information about five-year cohort graduation 
rate. Retrieved June 11, 2020, from https://www.cde.ca.gov/ds/sd/sd/fycgrinfo.asp 


DataQuest (n.d.) Five-year cohort graduation rates. California Department of Education. Retrieved June 11, 
2020, from https: //data1.cde.ca.gov/dataquest/ 


California Department of Education (2020, January 8). Five-year cohort graduation rate and outcome data. 
Retrieved June 11, 2020, from https://www.cde.ca.gov/ds/sd/sd/filesfycgr.asp 


The California Department of Education (CDE) reports a measure of “College/Career Readiness.” CDE reports 
the measure as an indicator of “the number of high school graduates who are prepared for college or a career” 
and it defines readiness as “completing rigorous coursework, passing challenging exams, or receiving a state 
seal.” CDE uses the college/career indicator to assign graduating high schools’ students to one of the following 
three categories: “Prepared,” “Approaching Prepared,” or “Not Prepared.” 


California Department of Education (2019, November 4). College/career readiness calculation [webpage]. 
Retrieved March 17, 2020, from https://www.cde.ca.gov/ta/ac/cm/ccical.asp 


California Department of Education (2019, December). 2019 California school dashboard technical guide: 
Final version 2019-20 school year. Retrieved April 14, 2020, from https://www.cde.ca.gov/ta/ac/cm/ 
documents/dashboardguide1g9.pdf 


California Department of Education (2020, May 15). California school dashboard and system of support 
[webpage]. Retrieved May 20, 2020, from https://www.cde.ca.gov/ta/ac/cm/index.asp 


California Department of Education (2019, December). 2019 California school dashboard technical guide: 
Final version 2019-20 school year (pp. 80-83, 87, 257-258). Retrieved April 14, 2020, from https://www.cde. 
ca.gov/ta/ac/cm/documents/dashboardguide19.pdf 


Summit Public Schools (n.d.). Our results [webpage]. Retrieved May 18, 2020, from https://summitps.org/ 
the-summit-model/our-results/ 


California Department of Education (2020, May 15). 2019 dashboard: Data files and record layouts - College/ 
career indicator - Data file (XLSX) [webpage]. Retrieved June 9, 2020, from https://www.cde.ca.gov/ta/ac/ 
cm/datafiles2019.asp 


California Department of Education (2020, April 9). 2019 dashboard: Data files and record layouts - College/ 
career indicator - Data file (XLSX) [webpage]. Retrieved June 9, 2020, from https://www.cde.ca.gov/ta/ac/ 
cm/datafiles2019.asp 


California Department of Education (2019, December). 2019 California school dashboard technical guide: 
Final version 2019-20 school year. Retrieved April 14, 2020, from https://www.cde.ca.gov/ta/ac/cm/ 
documents/dashboardguide1g.pdf 
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California Department of Education (2020, May 15). California school dashboard and system of support 
[webpage]. Retrieved May 20, 2020, from https://www.cde.ca.gov/ta/ac/cm/index.asp 


The California Department of Education (CDE) also recognizes two categories of graduating students who 
are not deemed prepared for college/career: those who are “approaching prepared “ and those who are 
“not prepared.” Of Summit Public Schools 2018-2019 graduates who were determined to be “approaching 
prepared,” the overwhelming number did so by completing Summit’s a-g coursework. 


California Department of Education (2019, December). 2019 California school dashboard technical guide: 
Final version 2019-20 school year (pp. 80-83, 88, 257-258). Retrieved April 14, 2020, from https://www.cde. 
ca.gov/ta/ac/cm/documents/dashboardguide19.pdf 


California Department of Education (2020, May 15). 2019 dashboard: Data files and record layouts - College/ 
career indicator - Data file (XLSX) [webpage]. Retrieved June 9, 2020, from https://www.cde.ca.gov/ta/ac/ 
cm/datafiles2019.asp 


This school-specific goal is not generally reported for public schools in the state of Washington. Summit 
Public Schools defines its own goal and how it will measure the goal, and provides the relevant data to the 
Washington State Charter School Commission. 


Halsey, J. (2020, April 28). Personal communication (telephone) with Christopher M. Saldana. 
See for example: 


Washington State Charter School Commission (n.d.). Summit Public Schools: Atlas — 2018-2019 annual 
student academic performance report (p. 21). Retrieved June 3, 2020, from https://charterschool.wa.gov/ 
documents/Summit-Atlas-2018-19-Academic-Report.Final_.pdf 


Washington State Charter School Commission (n.d.). Summit Public Schools: Atlas — 2018-2019 annual 
student academic performance report (p. 21). Retrieved June 3, 2020, from https://charterschool.wa.gov/ 
documents/Summit-Atlas-2018-19-Academic-Report.Final_.pdf 


Washington State Charter School Commission (n.d.). Summit Public Schools: Olympus — 2018-2019 annual 
student academic performance report (p. 19). Retrieved June 3, 2020, from https: //charterschool.wa.gov/ 
documents/Summit-Olympus-2018-19-Academic-Report.Final_.pdf 


Washington State Charter School Commission (n.d.). Summit Public Schools: Sierra — 2018-2019 annual 
student academic performance report (p. 19). Retrieved June 3, 2020, from https://charterschool.wa.gov/ 
documents/Summit-Sierra-18-19-Annual-Academic-Report.pdf 


The Cognitive Skills Rubric may be found at: 


Summit Learning (2019, April). Cognitive skills rubric. Retrieved June 3, 2020, from https://cdn. 
summitlearning.org/assets/marketing/Cognitive-Skills-Document-Suite.pdf 


Stanford University’s Center for Assessment, Learning, and Equity (SCALE) worked with Summit 

Public Schools (SPS) on its Cognitive Skills Rubric. The SCALE website lists June 2014 as the 
“anticipated”completion date of that project. According to SPS’s Research Roundup September 2017, SCALE 
also worked with Summit on additional research that led to changes to the Cognitive Skills Rubric made in 
2017. And according to the Cognitive Skills Rubric document we retrieved in June 2020, SCALE worked with 
SPS to create the most recent version of the rubric. When we contacted SCALE in August 2019, Research 

& Design Associate Laura Gutman told us that its staff wrote the rubrics and “benchmarked the levels to 
grade level standards.” When we asked for documentation that explains how the rubrics were created and 
benchmarked to grade level standards, she referred us to SPS, explaining that the project had been done 
several years prior, that the lead staff who had consulted on it were no longer at SCALE, and that she could 
not find any additional information to share with us at that time. Two versions of the rubric that we found 
(one dated May 2017 and the other dated April 2019) contain almost exactly the same categories, but there are 
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some differences in the skills detailed. 
Gutmann, L. (2019, August 26). Personal communication (email) with Faith Boninger. 
Gutmann, L. (2019, August 30). Personal communication (email) with Faith Boninger. 


Summit Learning (2017, September). Research roundup September 2017 (p. 12). Retrieved June 7, 2020, 
from https://core-docs.s3.amazonaws.com/documents/asset/uploaded_file/210681/research_roundup_ 
september_2017_.pdf 


Summit Learning (2017, May). Cognitive skills rubric. Retrieved June 20, 2019, from https://cdn. 
summitlearning.org/assets/marketing/Cognitive-Skills-Document-Suite. pdf 


Summit Learning (2019, April). Cognitive skills rubric. Retrieved February 4, 2020, from https://cdn. 
summitlearning.org/assets/marketing/Cognitive-Skills-Document-Suite. pdf 


Summit Public Schools (n.d.). Our results [webpage]. Retrieved May 18, 2020, from https://summitps.org/ 
the-summit-model/our-results/ 


Summit’s original claim that 55% of its graduates graduate college within 6 years, equivalent to twice the 
national average, appeared on the Summit Learning “About us” page. This webpage has since been revised 

to remove claims about Summit Public Schools. A revised claim, that graduates graduate college at twice the 
national average, appears on the Summit Public Schools website (we have retained screenshots of the cited 
webpages). SPS claims to have no responsive records to our Public Records Act request regardng these claims. 
See Appendix C for all correspondence related to this PRA request. 


Summit Learning (n.d.). About us [webpage]. Retrieved August 21, 2019, from https://www.summitlearning. 
org/about-us [no longer accessible] 


Summit Public Schools (n.d.). Our results [webpage]. Retrieved May 18, 2020, from https://summitps.org/ 
the-summit-model/our-results/ 


Primary among Summit Public Schools’ supporters have been the Bill and Melinda Gates Foundation and 
Mark Zuckerberg (via Facebook and then the Chan Zuckerberg Initiative). The Gates Foundation has funded 
Summit Public Schools every year from 2011-2012 through 2019-2020, for a total of $40,378,573 (see 
Appendix A). At the same time the Foundation aggressively promoted personalized learning more generally. 
Facebook’s initial agreement with Summit Public Schools included joint marketing. 


For the Gates Foundation’s role in promoting personalized learning, see: 


Boninger, F., Molnar, A., & Saldafia, C.M. (2019). Personalized learning and the digital privatization of 
curriculum and teaching. Boulder, CO: National Education Policy Center. Retrieved June 3, 2020, from 
https://nepce.colorado.edu/publication/personalized-learning 


For Facebook’s work with Summit Public Schools, see: 


Summit and Facebook Collaboration, Facebook, Inc. and Summit Public Schools, August 18, 2015. Retrieved 
February 20, 2020, from http://blogs.edweek.org/edweek/DigitalEducation/Summit_Facebook_Signed_ 
Agreement_2015.pdf 


Tavenner, D. (2012, September 6). Moving beyond blended learning to optimized schools [blog post]. Michael 
and Susan Dell Foundation. Retrieved June 3, 2020, from https://www.msdf.org/blog/2012/09/dianne- 
tavenner-moving-beyond-blended-learning/ 


Tavenner, D. (2012, December 7). Embarking on year two: Moving beyond blended learning. Getting Smarter. 
Retrieved February 12, 2020, from https://www.gettingsmart.com/2012/12/embarking-on-year-two-moving- 
beyond-blended-learning/ 
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Wilka, M. & Cohen, J. (n.d). It’s not just about the model: Blended learning, innovation, and year 2 at 
Summit Public Schools. Summit Public Schools and FSG. Retrieved January 28, 2020, from https://www.fsg. 
org/publications/its-not-just-about-model 


[Although the report is undated, its filename (Summit Y2_Blended Learning and Innovation_Content 
Final_2_9 24 13.pdf) suggests that it was released in September, 2013] 


Summit Public Schools (2012, August 13). Summit Public Schools: Changing education, changing lives 
[video]. Retrieved February 5, 2020, from https://vimeo.com/47429811 


Summit Public Schools’ 2017 final report to the Chan Zuckerberg Initiative detailed the goal of convincing 
school community members of the Summit Learning Program’s efficacy. 


Summit Public Schools (2017, June). Summit Public Schools final report. Retrieved May 14, 2020, from 
https://cdn.vox-cdn.com/uploads/chorus_asset/file/19931497/Grant_Reports_PRA_M._Barnum_2_2_1.pdf 


In 2015, Summit’s digital platform was called the “Personalized Learning Plan” (PLP). 


Summit and Facebook Collaboration, Facebook, Inc. and Summit Public Schools, August 18, 2015. Retrieved 
February 20, 2020, from http://blogs.edweek.org/edweek/DigitalEducation/Summit_Facebook_Signed_ 
Agreement_2015.pdf 


Chalkbeat obtained Summit Public Schools’ final report to the Chan Zuckerberg Initiative. 


Summit Public Schools (2019, January 31). Chan Zuckerberg Foundation final report. Retrieved June 3, 
2020, from https: //cdn.vox-cdn.com/uploads/chorus_asset/file/19931497/Grant_Reports_PRA_M. 
Barnum_2_2_1.pdf 


See also: 


Barnum (2019, August 22). Summit Learning reports highlight big ambitions for personalized learning, 
struggles to prove academic success. Chalkbeat. Retrieved February 11, 2020, from https://chalkbeat.org/ 
posts/us/2019/08/22/summit-learning-reports-ambitions/ 


Summit Public Schools (n.d.). The science of Summit. Retrieved February 5, 2020, from https://summitps. 
org/wp-content/uploads/2018/09/The-Science-of-Summit-by-Summit-Public-Schools_08072017-1.pdf [The 
document is not dated, but the filename appears to have a date of August 7, 2017] 


Summit Public Schools (2019, January 31). Chan Zuckerberg Foundation final report. Retrieved June 3, 
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